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Abstract 

This study aims to explore Bayesian multilevel modeling to investigate variations of average academic 
achievement of grade eight school students. A sample of 636 students is randomly selected from 26 private and 
government schools by a two-stage stratified sampling design. Bayesian method is used to estimate the fixed and 
random effects. Input and process quality indicators of education such as student to class ratio, student to teacher 
ratio, availability of teaching learning resources at school, teaching methods, and standard of course curriculum are 
found to be significantly affecting the academic achievement of the students. The effects of student level 
covariates: absence from class, academic motivation, academic self concept, study time, family income, mother’s 
education, parents’ employment status, work demand at home, and parent’s follow-up of child are significantly 
varying from school to school. The results show that a large proportion of academic achievement variation is 
accounted to between schools. It is interesting to found out that the within school variation is very high for 
government schools while the between school variation is very high for private schools. There is uniformity across 
the government schools with high individual differences among students. However, there is lesser uniformity 
across the private schools with lesser individual differences of students. The findings in this study indicate that 
private schools are in a better position in maintaining quality of education at grade eight. Efficient academic 
management is needed at the government schools that can improve quality of education at the level. 

Keywords: achievement, Bayesian multilevel, grade eight, primary school, students, variation 

1. Introduction 

Education is an important means of achieving sustainable economic development. It plays a vital role in optimal 
utilization of resources through development of human capital and improve their quality of life. Quality of human 
resources highly related to the quality of education (Battle & Lewis, 2002). Educators and researchers have agreed 
upon on the nature of educational quality typically measured by achievement of students in national examinations 
(Pangeni, 2014; Mersha, Bishaw, & Tegegne, 2013). 

The quality of education remains top priority of research and long been interested in exploring predictors 
contributing effectively related to students, parents, teachers and schools (Mushtaq & Nawaz Khan, 2012; Farooq, 
Chaudhry, Shafiq, & Berhanu, 2011; McCoach et al., 2010; Salami, 2008; Sackey, 2007; Barnard, 2004; Jeynes, 
2003). On the other hand, researches on academic achievement concluded that school level effects is less 
important than student level, i.e., no consistent relationship exists between school characteristics and academic 
achievement (Shera, 2014). By contrast, school characteristics: school environment, school type and school 
resources make a significant effect on student academic achievement (OECD, 2010b; Konstantopoulos, 2006). 
Consequently, researchers suggested and concluded that the effects of school and student level predictors vary and 
inconsistence across studies and countries context as result there is a longstanding debate of whether student or 
school characteristics have larger effects on academic achievement of students (Bowers & Urick, 2011; Wobmann 
& West, 2006). 

Multilevel models have gained dramatic application in educational data possessing a nested hierarchy and more 
generally for investigating uncertainty at different levels of aggregation (Raudenbush & Bryk, 2002; Goldstein, 
2011). Due to this nested structure of educational data the researchers agreed that multilevel model become a 
standard method for combining student and school level covariates for simultaneous estimation, extracting 
unobserved heterogeneity, decomposing and quantifying variations at student and school levels with associated 
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predictors. It incorporates parameters that govern the dependence structure with complexity of errors structure. 
Bayesian method applies to address the parameters estimation problem in multilevel modeling (Loy, 2013; 
Snijders & Berkhof, 2008; Hox, 2010; Perer, 2006). 

Expansion of enrollment of primary schools alone is not sufficient unless the education system ensures the quality 
of education so that the students attain expected level of basic knowledge and skills. Studies have indicating that 
expansion of primary education in the country has compromising the quality. The quality of education remains 
challenging in most sub-Saharan African countries, including Ethiopia. Quality of educational output which can be 
measured by the achievement score of students on national examination is a crucial issue in low and middle 
income countries because of countries’ efforts to maintain quality in the context of quantitative expansion of 
educational provision with limited resources (UNESCO, 2012; Grimm, 2011). Ethiopia is one of those countries 
which have placed strategies to increase quality of education with improving the academic achievement of 
students. 

Ethiopia has made rapid expansion of gross enrollment rates of primary school from 20% in the early 1990 to 
85.4% in 2010/2011 (MoE, 2012). Great efforts are made in expanding educational provision and opportunity, but 
not maintaining the expected quality of education. This is reflected on low academic achievement in national 
examination at the end of primary school (MoE, 2012). Students are often not equipped with the necessary 
numeracy, literacy and life skills at primary schools, and that there is a considerable challenge to meet the quality 
standards of education at primary schools in the country. The current study is thus to investigate contributing 
factors to the academic achievements of grade eight students, as a quality measure of education, and explore 
between and within school variations using Bayesian multilevel modeling. 

2. Data Description 

Target population is 7532 students who took grade eight national examination in the year 2009 GC at Hawassa city 
across 26 primary schools. A sample of 636 students is randomly selected using a two-stage stratified random 
sampling technique, with 468 students among 5733 from government schools and 168 students among 1799 from 

private schools. The data has a nested structure: student level with in school level. The sample size /? ( for student 

level is determined using the formula Yl i =N t Z 2 /2 Sf /(N i d^+Z 2 a/2 Sf) as given in Cochran (1909), where N i 

is total number of students at school type i= 1,2 (government, private), S 7 is sample variance estimated from a 

pilot survey, Z a/2 =1.96 is the critical value on the standard normal distribution at a =0.055 significance level, 
and d =0.02 is margin of error. 

The student’s average achievement of grade eight national examinations, as outcome variable, is obtained from 
the Department of Education and Capacity Building of Hawassa City Administration. Average achievement is 
measure as scores out of 0-100%. The respective primary data are collected on predictor variables from the 
identified students, teachers and school principals using a designed questionnaire and interviews. 

3. Multilevel Linear Model 

Educational data are often hierarchical in nature consequently classical regression models are not appropriate for 
analysis due to the presence of intra-class correlation within cluster which fail to take into account the nested 
nature of the data, consequences biased standard errors and estimates, but multilevel model allows simultaneous 
estimation of parameters from different levels and quantify between and within cluster variations (Guo, 2005; 
Singer & Willet, 2003; Raudenbush & Bryk, 2002). Bayesian method with non-informative prior is applied to this 
model to estimate the parameters using MCMCglmm R package (Finch, Bolin, & Kelley, 2014; Bates, Maechler, 
& Bolker, 2013; Snijders & Bosker, 2012; Hox & Roberts, 2011). Thus, the multilevel models to fit the primary 
school achievement data are given below. 
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3.1 Variance Components Model 

The variance components model has the form: 


Y ij =^0 


u 


oj 


oij 


(1) 


where y is average academic achievement of ; th student in / h school; jj . ‘s are school level random effects that 


are i.i.d. normally distributed with zero means and constant variances <j 2 ; £ 0 y ‘s are errors that are i.i.d. normally 

distributed with zero means and constant variances a :; J3 0 is overall average academic achievement. 

The model decomposes the total variance into two-that of school and students levels, representing the between and 
within schools variabilities in the academic achievement of students (Hox & Roberts, 2011). The interclass 
correlation (ICC) measures correlation between observation within cluster as: 

ICC = ° " 2 (2 ) 

O" u + ° e 

3.2 Random Intercept Model 

The model contains random intercept and fixed slopes for the covariates at both levels-it is given by: 

Y ij = + P' Xu i + + P ’« X mij + U Oj + Pm + l X m + l.j + - + P p X p.ij + S ij ( 3 ) 

overall school level student level 

mean 

where Y tJ is average academic achievement; X mij ‘s is are covariates from the two levels and p m ‘s are fixed 
regression parameters to be estimated. Similarly U oj ‘s are school level random effects independently normally 


distributed with zero means and constant variances a 2 and S oi - ‘s are errors independently normally distributed 

with zero means and constant variances rr 2 ■ 

£ 

3.3 Random Coefficients Model 

This model is with varying intercept and slopes has the form: 


Y ij~ Po + P\ X \ii + - + Pm X m 


+ U 0 j + P, 


m+\,j X m+\,ij + - + Ppj X p.j +U l J X m + l,ip-- +U pJ X p 




overall 

mean 


schoollevel 


studentlevel 


( 4 ) 


where the variables are same as equation (3) except the student level covariates are assumed to have random 
effects. School level predictors are kept fixed. The random effects r/ ,rj , ... , ,, independently normally 

oj 1 j pj 


distributed with zero means and constant variances. £ m - ‘s are errors independently normally distributed with zero 
means and constant variances a ) : ■ 

The Bayesian inferences all depend on the posterior distribution of the parameters given the data which is 
expressed in generic form as: 

n{p,al,a;\y,x) a L(y,x\ a*, a 2 E )7r(P) Trivial) (5) 
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Fixed parameters are assumed to have normal distributions with large variances, and variances of the response 
variable and the random effects are assumed to have inverse gamma distributions. The Bayesian method is applied 
in the MCMCglmm R package (RDev Core Team, 2013; Hadfteld, 2010; Browne & Draper, 2006; Gelman, 2006). 
With default non-informative prior distributions, the posterior distributions are simulated using Gibbs sampler 
until convergence and then estimates of the model parameters are computed. 

4. Results 

4.1 Descriptive Analysis 

The total of 636 students considered in this study are who took grade eight national examination at the end of 
primary school from government and private schools of Hawassa City. The average academic achievement of 
students at private schools is (mean± SD) 76 + 3.5 and 35.1+4.1 at government schools. It seems that students at 
private schools perform better than that of government schools. Students with very high academic motivation 
achieve (45.36+ 12.17) which is higher than that of those with low academic motivation score (35.23 + 5.72). 
Students who are absent from school most of the time achieve (33.15 + 4.03) which is lower than that of those who 
are never absent (58.55 ± 11.82). Inferences are given here below. 

4.2 Results of Variance Components Model 

The results from analysis of variance components model (1) are displayed in Table 1. The results indicate that the 
overall average is significant and it is estimated to be 48.3% with standard error of 2.445. The between and within 
school variations are also statistically significant at 5% significant level. About 79% of variation in the academic 
achievement of the students is accounted to the between schools, while 21% is accounted to the students. 


Table 1. Bayesian variance 

components model (n=636) 




Parameter 

Estimate 

SE 

95% Cl 

LL UL 

Sign. 

Fixed part 





Intercept 

48.3 

2.445 

43.52 53.11 

0.000* 

Random part 





School variance 

153.6 

49.685 

77.98 254.10 


Residual variance 

40.1 

2.329 

35.80 44.66 


ICC 

0.79 




DIC 

4152.20 




Note. CI=Confidence Interval, LL : 

=Lower Limit, UL=Upper Limit, SE= 

Standard Error. 




* Significance at a=0.05. 


4.3 Results of Random Intercept Model with Covariates 

Results of analysis of the random intercept model (3) are displayed in Table 2. Intercept and several covariates are 
significant. There is much reduction of DIG to 3629.96 in model (3). The between and within school variations are 
statistically significant. About 43% of variation in the academic achievement of the students is accounted to the 
between schools, while 57% is accounted to the students level. The proportions of variations explained by the 
covariates are R 2 = 92% for school level and R 2 =57.4% for student level. 

Among covariates at the student level, the following are found significant at 5% significant level: student absence 
from class, academic motivation, academic self concept, study time, family income, availability of books at home, 
mother’s education, parents’ employment status, work demand at home, and parents follow-up of child. Sex is not 
significant. Academic achievement of a student at 8 th grade national exam can increase by increasing student 
non-absence from class, academic motivation of student, academic self concept, study time, family income, 
availability of books at home, mother’s education, parents employment status, lowering work demand at home, 
and parents follow-up of child. School absenteeism and work load demand at home by parents are negatively 
associated with achievement. For instance, a student who is absent a unit of time is likely to reduces reduce his 
average achievement by 6.5%. Increase in family income by a unit of currency increases achievement by 7.5%. 
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Parents need to reduce the time the student spends for household works and motivate the child to give more time 
for studying. 

For the school level, the significant predictors are: teaching method, student to teacher ratio, student to class ratio, 
school distance from home, availability of teaching learning resources at school, student satisfaction with school 
environment and standard of curriculum. Teachers’ motivation is not significant. 

Quality indicators of education like student to class ratio, student to teacher ratio, instruction method in the class, 
availability of teaching-learning resources at school, and standard of curriculum are significantly related to the 
overall average academic achievement of students of the primary schools. Class size, student to teacher ratio and 
distance of school from home are negatively associated with student performance. Reducing student to class ratio 
and student to teacher ratio by a unit increases the academic achievement of a student by 9.6% and 3.4%, 
respectively. 


Table 2. Random intercept Bayesian model 


Parameter 

Estimate 

SE 

LL 

95% Cl 

UL 

Sign. 

Fixed part 






Intercept 

19.695 

1.458 

17.022 

22.634 

0.000* 

Student level covariates 






Sex 

0.648 

0.352 

-0.073 

1.310 

0.064 

Student absence from class (rev) 

6.498 

0.801 

4.794 

7.940 

0.000* 

Academic motivation 

0.651 

0.162 

0.334 

0.963 

0.001* 

Academic self concept 

1.656 

0.778 

0.078 

3.045 

0.030* 

Time spent on study 

3.166 

0.670 

1.825 

4.464 

0.000* 

Family income 

7.519 

0.634 

6.290 

8.805 

0.000* 

Availability books at home 

0.412 

0.193 

-0.012 

0.743 

0.038* 

Mother education 

0.422 

0.209 

-0.003 

0.821 

0.046* 

Parents employment status 

1.342 

0.556 

0.352 

2.491 

0.016* 

Work demand at home (rev) 

0.427 

0.183 

0.044 

0.751 

0.020* 

Parents follow-up of child 

2.087 

0.630 

0.874 

3.307 

0.000* 

School level covariates 






Teaching method 

2.136 

0.767 

0.686 

3.602 

0.004* 

Teachers motivation 

3.005 

1.694 

-0.183 

6.269 

0.076 

Student to class ratio (rev) 

9.583 

1.844 

6.186 

13.092 

0.000* 

Student to teacher ratio (rev) 

3.470 

1.689 

0.298 

6.813 

0.042* 

School distance from home (rev) 

0.926 

0.406 

0.193 

1.719 

0.014* 

Teaching resources at school 

1.172 

0.575 

0.014 

2.217 

0.044* 

Students satisfaction on school 

1.611 

0.668 

0.266 

2.914 

0.028* 

Standard of curriculum 

2.314 

0.709 

1.041 

3.826 

0.000* 

Random part 






School variance 

12.87 

4.777 

5.689 

21.78 


Residual variance 

17.08 

1.026 

15.04 

18.94 


ICC 

0.430 





DIC 

3629.960 






Note. CI=Confidence Interval, LL=Lower Limit, UL=Upper Limit; SE=Standard Error. 
*Significance at a=0.05; rev: variable measured in reverse order so as to see positive effect. 
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4.4 Results of Random Coefficients Model with Covariates 

Results of analysis of the Bayesian random coefficients model (4) are displayed in Table 2. The Bayesian approach 
has provided more precise estimates of the model parameters as compared to the likelihood methods. The results 
show that the random effects are significant. Intercept and several covariates are significant. The DIC=3624.42 of 
this model (4) is the lowest, showing that the Bayesian random coefficients model is best fitting to the data. The 
between and within school variations are statistically significant. About 41.5% of variation in the academic 
achievement of the students is accounted to the between schools, while 58.5% is accounted to the students level. 

Among covariates at the student level, the following are found significant at 5% significant level: student 
absenteeism, academic motivation of students, academic self concept, study time, family income, mother’s 
education, parents employment status, work demand at home, and parents follow-up of child. Sex and availability 
of books at home are not significant. Academic achievement of a student at 8 th grade national exam can be 
increased by increasing student non-absence from class, academic motivation of student, academic self concept, 
study time, family income, mother’s education, parents employment status, lowering work demand at home, and 
parents follow-up of child. Absence from class and high work time at home activities are negatively related with a 
student’s achievement, while study time has positive effect. For instance, a student who is absent a unit of time is 
likely to reduce his average achievement by 6.5%. Increase in family income by a unit of currency increases 
achievement by 7.5%. Parents need to reduce the time the student is to spend for household works and rather 
motivate the child to give more time for studying and doing home works. Parent’s follow-up of the child is so 
important that the child always goes to school and gets proper education. Academic motivation and self concept 
are to be boosted by teachers and parents. 

For the school level, the significant predictors are: teaching method, student to teacher ratio, student to class ratio, 
school distance from home, availability of teaching learning resources at school, student satisfaction with school 
environment and standard of curriculum. Teachers’ motivation is not significant. Indicators of quality of education 
such as teaching method, student to class ratio, student to teacher ratio, and standard of the curriculum are 
significantly affecting the academic achievement of students. Class size, student to teacher ratio and distance of 
school from home are negatively related to the student performance. Reducing student to class ratio and student to 
teacher ratio by unit increases academic achievement of a student by nearly 9.4% and 3.3%, respectively. 
Reducing distance of home to school by ten kilometers can increase achievement of the student by nearly 10%. 
Ministry of education needs to optimally locate primary schools to reduce school distance from villages and 
households. 


Table 3. Random coefficients Bayesian model 


Parameter 

Estimate 

SE 

95% Cl 

LL 

UL 

Sign. 

Fixed part 

Intercept 

20.477 

2.955 

16.016 

24.883 

0.002* 

Student level covariates 

Sex 

0.604 

0.343 

-0.098 

1.222 

0.08 

Student absence from class (rev) 

6.188 

5.487 

0.949 

11.653 

0.048* 

Academic motivation 

0.690 

0.158 

0.382 

0.991 

0.00* 

Academic self concept 

1.508 

0.794 

-0.044 

3.034 

0.046* 

Time spent on study 

3.046 

0.699 

1.727 

4.492 

0.00* 

Mother education 

0.395 

0.206 

0.016 

0.813 

0.048* 

Family income 

7.528 

0.622 

6.379 

8.781 

0.000* 

Parent employment status 

1.307 

0.691 

0.156 

2.567 

0.040* 

Availability of books at home 

0.370 

0.227 

-0.079 

0.750 

0.084 

Work demand at home (rev) 

0.463 

0.184 

0.130 

0.840 

0.010* 

Parents follow-up of child 

2.206 

0.703 

1.040 

3.507 

0.004* 
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School level covariates 


Teaching method 

2.311 

0.762 

0.720 

3.685 

0.006* 

Teachers motivation 

3.017 

1.738 

0.502 

6.237 

0.092 

Student to class ratio (rev) 

9.384 

1.763 

6.043 

12.957 

0.001* 

Student to teacher ratio (rev) 

3.317 

1.737 

0.084 

6.913 

0.040* 

School distance from home (rev) 

0.985 

0.429 

0.140 

1.816 

0.028* 

Teaching resources at school 

1.079 

0.567 

-0.047 

2.095 

0.048* 

Student satisfaction on school 

1.653 

0.656 

0.454 

2.897 

0.014* 

Standard of curriculum 

2.218 

0.722 

0.946 

3.744 

0.002* 

Random effects 






School variance 

11.930 

4.583 

4.655 

20.200 


Residual variance 

16.800 

1.046 

14.790 

18.810 


Student absence from class (rev) 

4.004 

6.396 




Academic motivation 

0.131 

0.056 




Availability of books at home 

0.105 

1.663 




Parent employment status 

0.115 

1.297 




ICC 

0.415 





DIC 

3624.419 






Note. CI=Confidence Interval, LL=Lower Limit, UL=Upper Limit, SE=Standard Error. 
*Significance at a=0.05 rev: variable measured in reverse order so as to see positive effect. 


4.5 Variance Components Models by School Type 

The Bayesian analyses of variance components are conducted for the government and private schools data 
separately. Results are given in Table 4. The results indicate that the between school variation is about 1% for the 
government schools and 67% for private schools. There is high similarities among the government schools. 
However, there is very high within school variation (99%) for government schools as compared to 33% for within 
private schools. The findings reveal that there is high achievement variation at government schools due to students 
individual differences. On the contrary, there is lower achievement variation at private schools and higher. It seems 
that individual differences are managed to be lower as compared to that of government ones while they still 
maintain higher variation between them-possibly due to competition and efficient academic management. 

Table 4. Bayesian variance components model by school type 

Government School Private School 


Parameter 

Estimate (SE) 

95% Cl 

LL UL 

Sign. 

Estimate (SE) 

95% Cl 

LL UL 

Sign. 

Fixed part 









Intercept 

38.8(0.333) 

38.15 

39.45 

0.00* 

58.0(3.073) 

51.47 

63.67 

0.00* 

Random part 









School variance 

0.36(0.830) 

0.00 

2.29 


109.5(56.2) 

28.35 

222.60 


Residual variance 

36.8(2.507) 

32.26 

41.15 


52.8 (6.25) 

41.10 

64.93 


ICC 

0.01 




0.67 





Note. CI=Confidence Interval, LL=Lower Limit, UL=Upper Limit; SE=Standard Error. 
*Significance at a=0.05. 
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5. Conclusions 

This study aims to explore Bayesian multilevel modeling to investigate variations of average academic 
achievement of grade eight school students in Ethiopia. A sample of 636 students is randomly selected from 26 
private and government schools based on a two-stage stratified sampling. Academic achievement is considered as 
a quality measure of education. Between and within school variations are studied. 

The Bayesian method has provided more precise estimates of model parameters as compared to the likelihood 
methods. The Bayesian random coefficients model best fits to the data. The Bayesian random intercept model is in 
equivalent performance and can be interpreted. 

The factors identified to be significantly affecting achievement of students are: (1) for student level: student 
absence from class, academic motivation of students, academic self concept, study time, family income, mother’s 
education, parents employment status, work demand at home, and parents follow-up of child; (2) for school level: 
the significant predictors are: teaching method, student to teacher ratio, student to class ratio, school distance from 
home, availability of teaching learning resources at school, student satisfaction with school environment and 
standard of curriculum. Sex, availability of books at home, and teachers’ motivation are not significant. 

There are achievement variations due to between schools and within schools at the primary schools. Variation of 
41.5% is accounted to the between schools and 58.5% to the students. For government schools, the between school 
variation is quite low (1%) and within school variation is very high (99%). So, there is high uniformity across the 
schools and high individual differences among students. High uniformity may mean less completion. Flowever, for 
private schools the between school variation is fairly high (67%) and the within school variation is reasonably low 
(33%). There is lesser uniformity across the schools and lesser individual differences among students. This may be 
possibly due to the current practice of competition and efficient academic management at the private schools. The 
findings in this study indicate that private schools are in a better position in maintaining quality of education at 
grade eight. 

Due to the fact that national examination at the end of primary school measures overall quality of education at that 
level, the findings imply that quality of primary education varies from school to school and is significantly affected 
by the input and the process variables. This may indicate certain inequities in the school system. The government 
needs to intervene based on the input indicators investigated in this study in order to improve the teaching and 
learning environment at the primary schools in the country. A lot can be learnt from both government and private 
school practices. Parents need to financially and morally support their children to always go to school and get 
proper education. They are also to reduce work load of the children and rather motivate them to give more time for 
studying and doing home works. Teachers and school system need to boost academic motivation and self concept 
the students. 
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